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Abstract —This study focuses on the mobile video delivery from 
a video server to a multi-homed client with a network of het¬ 
erogeneous wireless. Joint Source-Channel Coding is enectively 
used to transmit video over bandwidth-limited, noisy wireless 
networks. But most existing JSCC methods only consider single 
path video transmission of the server and the client network. 
The problem will become more complicated when consider multi- 
path video transmission, because involving low-bandwidth, high- 
drop-rate or high-latency wireless network will only reduce the 
video quality. To solve this critical problem, we propose a novel 
Path Adaption JSCC (PA-JSCC) method that contain below 
characters: (I) path adaption, and (2) dynamic rate allocation. 
We use Exata to evaluate the performance of PA-JSCC and 
Experiment show that PA-JSCC has a good results in terms 
of PSNR (Peak Signal-to-Noise Ratio). 

Index Terms —mobile video delivery; heterogeneous wireless 
networks; multi-homing; joint source channel coding 

I. Introduction 



Pig. 1. lllusUudon of a mobile video sUeuming service in a helerugeneous 
wireless network. 
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Nowadays handheld devices (e.g., smartphone and iPad) 
is explosive increasing, on the other hand, mobile video 
streaming (e.g., Hollywood [1] and Metacafe [2]) has became 
one of the most popular portion of network flow. According 
to the Cisco Visual Index [3] report, tlie percentage of mobile 
video streaming is 57% in 2012 and will increase to 69% 
by the year 2017. As a result, focus on mobile video quality 
guarantee study is meaningful. 

With the progress of technology mobile devices users could 
access network with various options (e.g., WLAN, 3G/4G and 
WiMAX), but problem still existing because bandwidth lim¬ 
itation of single wireless causing bottleneck of mobile video 
quality promotion. Contemporary WLAN systems could not 
guarantee video streaming quality because of small coverage 
area and limited bandwidth when there are number of mo¬ 
bile users [4-5]. Meanwhile, cellular networks (e.g.. UMTS) 
could provide more reliable service to mobile users, but their 
bandwidth is finite for high-quality video transmission [6]. 
Tlie 4G LTE and WiMAX could provide higher transmission 
rate and larger coverage area, however, they are not widely 
applied and bandwidth limitation also existing as the number 
of mobile users increases. Above all. the limitation of single 
wireless network turn research attentions to multi-path video 
transmission. 

To solve the existing problem, researchers proposed joint 
source-channel coding (JSCC) and proved it was an effec¬ 
tive approach in noisy wireless networks. But existing JSCC 
approaches (e.g.. [7-8]) only consider single path between 


server and client to transfer mobile video. Tlie problem 
becomes more complicated when consider multi-path video 
transmission in heterogenous wireless network. Fig. 1 shows 
the problem, in location 1. the user encounter a video problem 
because the cellular link not transfer the streaming well. In 
location 2, the user requests to the video server and in the 
meanwhile access WLAN network, but because of the unstable 
WLAN link, the video quality reduce more. In location 3 
which the place user could connect to WiMAX and then the 
perceived quality became better than in location 1 and 2. This 
can be summarized as the user-perceived video quality will 
only be reduced when involving an unreliable wireless access 
network. 

To improve the JSCC approach for mobile video transmis¬ 
sion in heterogeneous wireless networks, we propose a path 
adaption JSCC (PA-JSCC) in this study. The term ’path adap¬ 
tion* means dynamically selecting the appropriate wireless 
path and allocating the appropriate data rate to each of them. 
First, the video source rale adaption scheme is designed to 
meet the delay requirements of real-time video transmission. 
Second, the Forward Error Correction (FEC) redundancy esti¬ 
mation is employed to decrease the tolerable loss rate. Third, 
a effective flow allocation algorithm is proposed to reduce the 
end-to-end video distortion. 

Specifically, the contributions of this paper can be summa¬ 
rized in the following: 

• We present an efficient end-to-end video transmission 












solution which using JSCC and path selection algorithm 
in heterogeneous wireless networks in order to improve 
the transmission video quality. 

♦ We develop a mathematical model of JSCC for reducing 
the end-to-end video distortion with multi-path transmis¬ 
sion. 

♦ Using Exata implements semi-physical emulations with 
the real-time H.264 video streaming. 

The remainder of this paper is structured as follows. In 
Section II, we briefly discuss the related work. Section III 
presents the system model and problem formulation. The 
design of the proposed PA-JSCC description in detail is 
in section IV. In Section V, we provided the performance 
evaluation. Conclusion remarks are given out in Section VI. 
The basic notations used throughout this paper are listed in 
Table 1. 


TABLE I 

Basic notations used in this paper 



lienDitioD 

P 

the probability value. 

V,Pr 

ihe set of wireless access networks, rth access network. 

11 

the number ot available wireless networks. 


available bandwidth of Pr. 

TT,. 

the average loss rate of Pr. 

t, 

ihe propagation delay of Pt . 


the effective loss rate. 


the average burst length of Pr. 

k 

the number of source packets in a FEC block. 

n 

the total number ol htc packets in a FEC block. 

k/n 

Ihe thC code rate. 

V 

the video source (encoding) rate. 

s 

the htC data packet size. 

J 

the number ol video Irames m a UoK 

F 

the video frame rate. 


II. Related Work 

The related work to this study can be classified into two 
categories: (1) joint source channel coding, and (2) video trans¬ 
mission in heterogeneous wireless networks. In this section, 
we will discuss on each topic respectively. 

A. Joint Source-Channel Coding 

Most study of the joint source channel coding in video 
transmission are concentrated on flowing items: 1) find out 
most fitting video data rate for video flow, e.g., {9]; 2) deigning 
the channel coding algorithm to achieve the target rate, the 
Reed-Solomon [10], Turbo [11], and Fountain [12] codes; 3) 
considering the channel condition and design the video coding 
scheme to satisfied the requirement, e.g., [13]. But all this 
works only consider single path video transmission, it is a 
waste of multi-homed mobile devices. Different from previous 
JSCC methods, [14] study on the optimal FEC scheme and 
layer selection in multi-path scenario. 

B. Video Transmission in Heterogeneous Wireless Networks 

Video transmission in heterogeneous wireless networks has 
been a hot area of research and summarized in [15-16]. The 


EMS [17] and MPLOT [18] are typical protocols for heteroge¬ 
nous network based on erasure code. The Encoded Multipath 
Streaming (EMS) scheme splits traffic loads over multiple 
paths according to the path loss rate and dynamically adjusts 
the FEC redundancy. However, EMS was generally under the 
assumption that all the available paths could be beneficial 
for the transmission as in [14]. Multi-Path LOss Tolerant 
(MPLOT) is a transport protocol that aims at maximizing the 
throughput of the upper-layer application. But MPLOT can 
not guarantee real-time video delivery as it does not address 
tight delay constraints. 

III. System Model and Problem Formulation 

The PA-JSCC system model is described in Fig. 2. The 
scenario we considered is a heterogenous wireless network 
with wireless connections from a video server to a mobile 
device. This system involves three models: network model, 
end-to-end video distortion model and forward error correction 
(FEC) model. Next, we will introduce each of them simply. 


A. Network Model 


We consider each physical path Pr is associated with the 
following metrics to describe the network model: 

• the available bandwidth firy expressed in the unit of Kbps. 

• the propagation delay f,, which includes the link delays 
of the wired and wireless . 

• the average loss probability ttq € [0,1]. 

We employ continuous time Gilbert model to describe the burst 
loss behavior on physical path. The state A!r{t) assumes one 
of two values: G (Good) or B (Bad). G means the packet 
is successfully delivered at time t. Otherwise, B means the 
packet is lost. We denote by and ttq the stationary prob¬ 
abilities that Pj is good or bad. Let and represent the 
transition probability from G io B and B to G, respectively. 
In this paper, we adopt two system-dependent parameters to 
specify the continuous time Markov chain packet loss model: 
(1) the average loss rate x^, and (2) the average loss burst 
length 1/?^- Then, we can have: 


X/- = 




Cb+Cc 


and ttq — 


Cc 




( 1 ) 


B. Video Distortion Model 

Here we will introduce a generic video distortion model 
[19]. The end-to-end distortion (Aoiai) include the channel 
distortion (Dchi) ^nd the source distortion {D^rc)> Therefore, 
the end-to-end distortion can be written as: 


^xo\ai = -t^chl + ^ src* (2) 

Dsrc is mostly dependent on the video source rate and the 
video sequence parameters (e.g., the sequence complexity in 
proportion to the source distortion for the same encoding bit 
rate). The channel distortion is determined by the effective 
loss rate x^, which is caused by the delivery lost and video 




packets overdue. We can formulate Z)unai (in units of mean 
square error, MSE) as: 

AocaJ = A) + YT— Tj- 0 ’ '^D ' (^) 


in which a, Vq, Dq and 0 are constants for a specific video 
codec and video sequence. Since this model takes into account 
the effects of intra coding and spatial loop filtering, it provides 
accurate estimates for end-to-end distortion [20]. 


C. Forward Error Correction 

In this paper, we employ systematic Reed-Solomon (RS) 
block erasure code to eliminate channel losses. Genetically, a 
FEC block of n data packets includes k source packets and 
n — A: redundant packets. Most of time the receiver can fully 
reconstruct the original k data packets if at least k packets 
of the FEC block are correctly received. Particularly, the FEC 
code rate n/k needs to be dynamically chosen based on the 
loss requirement and channel status. 

In this paper, Reed-Solomon code is adopted to construct 
a virtual connection by aggregating multiple heterogeneous 
wireless networks. Actually, the uncertainty of the resulting 
virtual connection may increase although its total bandwidth is 
higher as the number of integrated wireless networks increases. 
Fountain code is very useful to overcome the uncertainty of 
a virtual path since its code rate is not fixed in a priori 
way and can be adjusted flexibly according to the wireless 
channel states. In general, a large source block size can 
reduce sensitivity to the wireless channel uncertainty at the 
cost of increased delay. In addition, fountain code has some 
advantages for video transmission over wireless networks due 
to its low encoding/decoding processing demand and high 
coding efficiency. 

Actually, the frame-level [21], GoP-level [22] or sub-GoP 
level [23] FEC coding is often applied for video data protec¬ 
tion. In this work, the GoP-level FEC (see Fig. 3) is employed 
for the data protection. 

D. Problem Formulation 

We are now ready to formulate the problem of flow rate 
allocation combining the JSCC for video delivery in heteroge¬ 
neous wireless networks. Note that, it is not practical for the 
video encoder to trace the frequent variation in source rate. 
Therefore, we adapt the source rate in units of GoP, based on 
the channel status, FEC code rate and delay requirements. To 
allow fast adaptation of the source rate to abrupt changes in 
the video content, this parameter is updated for each group of 
pictures (GOP) in the encoded video sequence, typically once 
every 0.25 second (with ,7 = 8 frames, F = 30 fps). The 
objective is to minimize the summation of the total distortion 
D,oiai subject to loss, delay and bandwidth constraints. 

For each GoP, determine the value of Cl, V, n 
to minimize 

Q 

T^loul = = -^0 + Y _y 0 ' ' 


subject to: 


V • n/k ■ — r — < ft>r 1 < r < 7?,. 

n 

V • n/k < fir- 

rsl 

(4) 


This is a nonlinear optimization problem with linear con¬ 
straints. With regard to the computational cost and conver¬ 
gence, it is impractical to derive the exact solution for the 
minimal video distortion. In the next section, we will show 
how to resolve this optimization problem in the design of the 
proposed PA-JSCC. 


IV. Design of Flow Rate Allocation based Joint 
Source Channel Coding 

In this section, we describe the overall design of the 
proposed PA-JSCC and outline the functionality of its major 
components. The architecture of the system framework is 
presented in Fig. 4. The system design includes components 
implemented in both the server and client side, respectively. In 
order to solve the optimization problem, at the server side we 
add two components: (1) path selector, (2) flow rate allocation. 
Particularly, the server side include a data distributor compo¬ 
nents, it responsibilities is split encoded video streaming into 
multiple available wireless networks and dispatching the FEC 
data packets onto different channels. 

At the client side, the video frames will be stored in the 
playback buffer after the FEC decoding process. The inter¬ 
frame resequence step aims at reordering the video frames in 
case they arrive at the client out-of-order. As each video frame 
is associated with a decoding deadline, the overdue frames will 
be discarded and concealed by copying from the last received 
ones. And we add an information feedback components to 
send channel status information back to server side. Next, we 
will describe the key components in the system design and 
their major functions. 



■ Data flow .^ Information flow Proposed component 


Fig. 2. System aichilecture for performance evaluation, 

A. Path Selector 

According to information theory [24], the video source dis¬ 
tortion can be minimized by increasing the effective encoding 
rate. On the other hand, the increasing encoding rate will 
lead to higher transmission rate which impose heavier load on 
channels. If the imposed load exceeds the network capacity, it 
will in turn result in longer delay and packet loss due to the 
network congestion. There is a inherent conflict between the 
source and channel distortion. The functions of path selector 
component contains determine the code rate on each path 
and define the maximum number of packets which can be 
transmitted using the constructed virtual link. 









B. Flow Rate Allocator 

Tlie source packets together with the redundancy packets 
consist of the ‘flow’ mentioned throughout tliis paper. The 
goal of the flow rate allocation is to select appropriate wireless 
access networks out of all the candidates so as to minimize 
end-to-end video distortion. The functions of the flow rate 
allocator is to allocate optimal flow rate of the flow. 


C. Information Feedback 

Estimating channel status information based on information 
feedback has been attracting research attentions for years. 
Over heterogeneous wireless networks, it is very important to 
identify the physical characteristics of each wireless channel 
in order to utilize channel resources etficienlly. The available 
bandwidth, propagation delay and channel loss rate are espe¬ 
cially important properties for a high quality video streaming 
service. Infonnation feedback components is used to transfer 
this necessary information back to server. 

V. Performance Evaluation 

In this section, we evaluate the efficacy of the proposed 
PA-JSCC by comparing it with the existing schemes for video 
delivery over heterogeneous wireless networks. We first de¬ 
scribe the emulation methodology that includes the emulation 
setup , performance metric and emulation scenario. 


A. Emulation Methodology 

]) Emulation Setup: We adopt the Exata and JSVM as 
the network emulator and video codec, respectively. The 
architecture of evaluation system is presented in Fig. 5 and 
the main configurations are set as follows. 



Mobile Trajeetorv 1 


Mobile Trajeetorv 2 
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Mobile Trajeetorv 3 


Mobile Trajeetorv ^ 


Fig. 3, System architecture for performance evaluation, 

• Exata 2.1 [32] is used as the network emulator. Exata is 
an advanced edition of QualNet [33] in which we can 
perform semi-physical emulations. 

• H.264/SVC reference software JSVM 9.18 [351 is 
adopted as the video encoder. The generated video 
streaming is encoded at 30 frames per second and a GoP 
consists of 8 frames. 

2) Performance Metric: We employ PSNR as the main 
metric of this study to evaluate the quality of the approach. 
PSNR (Peak Signal-to-Noise Ratio) is a standard metric of 
video quality and is a function of the mean square error 
between the original and the received video frames. 


3) Emulation Scenario: We conduct all the emulations in 
the mobile scenario with trajectories indexed from 1 to 4 as 
shown in Fig. 4. The four mobile trajectories represent the 
different access options for the mobile user in the integrated 
heterogeneous wireless networks, e.g., the user could simulta¬ 
neously access the UMTS and WiMAX while moving along 
the first trajectory. The mobile client requests lo the server 
through a wireless interface and constructs the connection 
whenever it moves in the coverage. The moving speed of the 
client is set to be 2 m/s in all the emulations. 

For the confidence results, we repeat each set of emula¬ 
tions with different video .sequences more than 5 times and 
obtain the average results with a 95% confidence interval. 
The microscopic and mobility results were presented with the 
measurements of finer granularity. 

B. Evaluation Results 

As shown in Fig. 8, PA-JSCC achieves higher PSNR values 
and lower variations than the other competing models. The 
average video PSNR in Trajectory 2 is lower than that in 
Trajectory 1 as the WLAN is less stable than the WiMAX. 
The results verify the instance in Fig. I and the conclusions 
in related work [6]. Besides, the superiority of PA-JSCC and 
FCVP over the other two schemes is larger in Trajectory 
3 and 4 as more wireless access networks are available. 
Tlie substantial improvements in video quality confirm the 
importance of JSCC in conjunction with flow rate allocation 
in heterogeneous wireless networks. PA-JSCC outperforms the 
FCVP as the Reed-Solomon code is more appropriate than 
the fountain code for the real-time video and thus reduce the 
erasure-coding-induced delays. In order to have a microscopic 
view of the results, we also depict the mean values and 
standard deviations (Stddev) of mobile trajectory 4 in Table 
IV. The per frame video PSNR during the interval of [0, 20] 
second is presented in Fig. 9. It can be observed that PA- 
JSCC maintains the PSNR values at a relatively higher range. 
In the mobile trajectory 1, the superiority of PA-JSCC over the 
JMRA becomes more obvious and due to the increa.se number 
of access options. 

VI. Conclusion and Discussion 

In this paper, we have presented a path adaption JSCC 
(PA-JSCC) approach for mobile video delivery in heteroge¬ 
neous wireless networks. Through modeling and analysis, we 
have developed solutions for FEC redundancy adaption, video 
source rate adaption and flow rate allocation. Experimental 
results show that the proposed PA-JSCC is able to dynamically 
select the appropriate wireless access networks out of all 
candidates and significantly improve the video PSNR. As 
future work, we will consider: (1) design a seamless vertical 
handoff algorithm for optimal-quality video in the integrated 
WLAN, WiMAX and Cellular networks. The work in [5] 
formulates the heterogeneous wireless networks as a restless 
bandit systems. However, it does not provide in-depth analysis 
on the physical characteristics (e.g., the coverage and received 
signal strength) of each wireless network; (2) include an 
optimal path interleaving mechanism with the PA-JSCC for 
overcoming the burst loss. 







TABLE II 

Average PS NR values for different videos. 


Compared Approaches 

1 Foreman \ 

1 Mother Daughter \ 

1 Hail 1 

1 Container \ 

1 Mean | 

1 Stddev 1 

1 Mean | 

1 Stddev 1 

1 Mean | 

1 Stddev 1 

1 Mean | 

1 Stddev 1 

PA-JSCC 

1 1 

1 0.62 1 

1 d4.S 1 

1 0.61 1 

1 36.? 1 

1 o.h6 I 

1 41.3 1 

1 0.93 1 
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